THEMIS  SIGNAL  ANALYSIS  STATISTICS  RESEARCH  PROGRAM 


o 

* 


v« '  • 

APPROXIMATIONS  TO  iJVRGE  PROBABILITIES  OP  ALL  SUCCESSES  FJJR 


GENERAL  CASE  AND  SOME  OPERATIONS  RESEARCH  IMPLICATIONS, 


by 


John  E.  Walsh  and  C.  J.  Kelleher 


;v 


1 

t 

t 

M 


Technical  Report  No.  25 
Department  of  Statistics  THEMIS  Contract 

February  20,  1909 


Research  sponsored  by  the  Office  of  Naval  Research 
Contract  N00014-68-A-0515 
Project  NR  042-260 


Reproduction  in  vhole  or  in  part  is  permitted 
for  any  purpose  of  the  United  States  Government. 


Distribution  of  this  document  is  unlimited. 


DEPARTMENT  OF  STATISTICS 
Southern  Methodist  University 


<•/ 


Best  Available  Copy 


APPROXIMATIONS  TO  LARGE  PROBABILITIES  OF  All,  SUCXG~CPS  FOR 


GE’tSKAL  CASE  APB  SOME  OPERATIONS  RESEARCH  IMPLICATIONS 


John  E.  Walsh 

Southern  Methodist  University 
Dallas,  Texas,  U.S.A. 


G.  J.  Kelleher 

Institute  for  Defense  Analyses 
Arlington,  Virginia,  U.S.A. 


ABSTRACT 

'%'r 

There  are  many  cases  where  an  overall  effort  is  successful  if  and  only 
if  the  efforts  (or  events)  of  a  sequence  are  all  successful,  often,  the 
principal  interest  is  in  cases  where  overall  success  has  a  large  probability 
(say,  at  least  .8) .  Suppose  there  are  n  efforts  in  the  sequence  and  that 
p.  is.  )  is  the  probability  that  the  i-th  effort  is  a  success  given  that 

preceding  efforts  1,  • * • ,  i-1  are  successes  (i=l,  ••*,  n),  where  sq 

denotes  no  conditions.  An  approximate  value,  also  sharp  upper  and  lower 
bounds,  are  developed  for  the  probability  that  all  n  events  are  successes. 
This  is  done  for  various  level;:,  of  generality,  including  a  form  of  complete 
generality.  These  results  depend  only  on  n,  the  generality  level,  and  the 
arithmetic  average  of  the  •  They  are  useful  when  the  probability  of 

all  successes  is  at  least  .8;  then  the  approximate  value  is  near  both  bounds. 

The  necessity  of  only  considering  the  arithmetic  average  of  the  p  (s  ), 

i  i-1 

rather  than  their  product,  sometimes  can  be  useful  in  analyses  of  an  operations 

research  nature  (including  reliability  situations) .  Consider  optimum  allotment 

1  .  > 

of  resources  to  obtain  a  stated  high  probability  of  all  successes.  ThifS  can  be 
obtained  by  minimizing  the  resource  use  subject  to  the  arithmetic  average  of 
the  equaling  a  determined  value.  This  minimization  is  often  less 

complicated  than  minimization  subject  to  the  product  of  the  (s^  )  having 

the  stated  value.  Also,  statist.. 4 -al  estimation  of  the  probabi.  'ty  of  all 
successes  is  simplified  when  the  expression  using  the  arithmetic  average  of 
the  p.  (s.  )  is  considered. 
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INTRODUCTION  AND  RESULTS 

Consider  n  binomial  events  (not  necessarily  independent)  where  success 
and  failure  are  the  possible  outcomes  for  an  event,  often,  cuecc  is  .interest 
in  whether  all  the  events  are  successes.  That  is,  there  is  overall  success  if 
and  only  if  every  event  results  in  success.  In  fact,  many  kinds  of  overall 
efforts  can  be  considered  to  occur  as  a  sequence  of  steps  (or  events)  with 
overall  success  occurring  if  and  only  if  all  of  the  stecs  result  in  success. 
This  is  often  the  case  for  reliability  situations  and  for  accompli shmtnt  of 
missions  (for  example,  military  missions) . 

■Hie  principal  interest  is  frequently  in  high  probabilities  of  overall 
success  (say,  at  least  .8) .  On’y  cases  with  high  probabilities  are  considered 
here. 

Let  the  n  events  be  numbered  according  to  the  segue  ice  in  which  they 
Can  be  considered  to  occur  (event  1  is  resolved  first,  etc  Use  (s^  ^ ) 
to  denote  the  probability  that  the  i-th  event  results  in  success  giv^  .  that 
events  1,  •**,  i-i  are  successes  (i  =  2,  •••,  n),  while  p  (so)  -  is 
the  unconditional  probability  that  the  first  event  is  a  success.  Then, 

n 

P(all  successes)  =  II  p  (s  ) 
i=l  1 

is  the  probability  that  all  the  events  tire  successes 

If  the  approximation  is  sufficiently  accurate,  there  are  advantages  in 


expressing  P{all  successes)  \r  terms  of  the  arithmetic  average  (denoted  by  p) 

of  the  p^(s^  •  First,  consider  operations  research  type  situations  where 

a  stated  large  value  of  P(all  successes)  is  required  and  this  is  to  be  cLLai 

with  an  optimum  allotment  of  resources .  This  can  be  accomplished  (approximately) 

by  minimizing  the  resource  use  subject  to  setting  p  equal  to  a  determin'd 

value.  Experience  indicates  that  this  minimization  is  usually  less  complicated 

than  minimization  subject  to  the  product  of  the  p^(s^  having  the  stated 

value . 

A  second  advantage  is  in  performing  statistical  investigation  when  the 
p  (s  ^)  must  be  estimated.  Probabilistic  properties  of  an  arithmetic  average 
of  estimates  are  usually  much  more  easily  determined  than  those  of  a  product 
of  estimates. 

Estimation  of  a  ^  is  often  not  difficult.  That  is,  (s^  ^) 

is  ordinarily  the  probability  thac  the  i-tb  event  is  a  success  given  that 
nothing  very  unusual  has  happened  (something  very  unusual  happens  only  if  at 
least  one  of  events  1,  •*•,  i-1  is  a  failure) .  For  example,  a  failure  in  a 
reliability  situation  can  result  in  a  large  stress  (perhaps  an  explosion) 
in  the  overall  system.  No  unusual  stress  occurs  if  all  preceding  events  are 
successes  Thus,  effectively,  p  (8^_^)  can  156  estimated  by  observations 
on  the  i-th  event  when  it  receives  no  unusual  stress.  Fortunately,  this  is 
the  case  in  which  observations  are  most  easily  and  inexpensively  obtained. 


1 

-  4  -  j 

t 

In  fact,  it  is  often  possible  to  separately  consider  the  i-th  event  (per- 

i 

haps  removed  fro®  the  overall  system)  if  suitable  environmental  conditions 

(temperature,  pressure,  etc.)  are  maintained 

For  the  cases  considered,  th*»  l^va]  of  general i+y  is  defined  in  terms 

of  the  number  r  of  uhe  p.  (s^)  are  required  to  be  at  most  equal  to  p. 

Complete  generality  occurs  for  r  =  1  and  the  generality  level  decreases 

as  r  increases.  However,  r  values  as  large  as,  say,  n/4  would  still 
seem  to  represent  a  moderate  degree  of  generality. 

Only  cases  where  n,  p,  r  are  such  that  (n~r+l)  (n-p)  is  less  than 

unity  are  considered.  Then,  for  any  meaningful  n  and  r, 

(1  -  (n-r+1) { 1— p) ]pr  *  £  P(all  sue  esses)  £  pn  . 

The  lower  bound  la  at  least  .8  if  n(l-p)  £  .2  and  is  a  monotonically 
increasing  function  of  r.  The  bounds  are  close  together  and  P(sll  successes) 
is  very  nearly  equal  to 

(l/2)pr‘1[pn"r+1  +  1  -  (n-r+1)  (1-p)  ] 

when  (1  -  (n-r+1) (l-p))pr  1  ia  at  least  .8. 

The  final  section  contain*  derivation*  of  these  probability  results. 

When  the  are  all  very  large,  n  is  large,  and  dependence  is  of 


a  restricted  nature,  the  more  easily  applied  approximate  results  of 


5 


(Walsh,  1955)  are  usable. 

VERIFI : AT ION 

For  notational  simplicity,  let  p  =  Since  the  geometric 

mean  of  the  p  is  at  most  equal  to  their  arithmetic  mean,  P(all  successes) 
£  pn,  with  equality  possible  (when  the  p^  are  equal) .  This  upper  bound 
and  its  basis  are  applicable  for  all  r. 

Now,  consider  derivation  of  the  sharp  lower  bound.  The  value  of 
P(all  successes)  is 


n 

II  p.  -  exp 
i=l  1 


n 

E  log  II 
i=l 


a 


Pi)) 


1 

J 


=  exp 


n  “> 

-EE  a  -  p,)5/} 

i.i  j.i 


CO 


j=l 


"  k 

E  (p  -  pi’ 

i=l 


n 

For  (r.-r+l)  ()  -  p)  <  1  and  k  *  2,  ^  (p 

i=l 


is  largest  when  all 


but  r  of  the  are  unity,  r-1  of  them  equal  p,  and  the  other  one  is 

such  that  their  arithmetic  average  is  p  (easily  verified  by  consider  ng 
the  cases  of  k  =  2 ,  3  and  the  relationships  for  larger  k) .  This  implies 
that  this  other  is  1  -  (n-r+1) (1  -  p)  ,  so  that  the  maximum  is 


£  (P  -  P.)*  =  (n  -  r)  (1  -  p)  +  (-1) *  (n  -  r)  (1  -  p)’ 


’thus,  since  r-1  of  the  p^  are  equal  to  p  and  also 


k  (0  ■*  ■ 


r)  +  (-l)Nn  -  r)  ]  [  (r.  -  r)  +  1]  ^  +  (n  -  r)  (1  ~  1)  ^ 


j  v*  ■>  1 

which  equals  (n-r+1) P(all  succes-es)  is  at  least  equal  to  p  *-imes 


(-  £  (!)  “ 


»  -  r)K  +  (-1) k (n  -  r) ] 


=  exp  J -  £  j" 1 [ (n-r+1) (1  -  p) ] 

M 


=  exp  <  loge  [1  -  (n-r+1)  (1  -  p) ] \  -  1  -  (n-r+1) (1  -  p)  , 


with  equality  possible. 
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There  are  many  case  where  an  overall  effort  is  successful  if  and  only  if 
the  efforts  ior  events)  of  a  sequence  are  all  successful.  Often,  the 
principal  interest  is  in  cases  where  overall  success  has  a  large  probability 
(say,  at  least  .8).  Suppose  there  are  r.  efforts  in  the  sequence  and  th^t 
n.  (s.  , )  is  the  probability  that  the  i-th  effort  is  a  success  given  that 
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preceding  efforts  1, 


,  t-1  arc  successes  (i«l,  ...  ,  n) ,  whei  s  denotes 


no  conditions.  ,\.i  approximate  value,  also  sharp  upper  and  lower  bounds,  are 
developed  for  the  probability  that  all  n  events  are  successes.  This  is 
done  for  various  levels  of  generality,  including  a  form  of  complete  gener¬ 
ality.  These  results  depend  only  on  n  ,  the  generality  leva),  and  the 
arithmetic  average  of  thv  p^(s.  ),  They  are  useful  when  the  probability  o* 

all  successes  is  at  least  .8;  men  the  approximate  value  is  near  both  bounds 
The  necessity  of  only  considering  the  arithmetic  average  of  the  p , 

rather  than  their  product,  sometimes  can  be  useful  in  analyses  of  an  operations 
research  nature  (including  reliability  situations).  Consider  optimum  allot¬ 
ment  of  resources  to  obtain  a  stated  high  probability  of  all  successes.  This 
can  be  obtained  by  minimizing  the  resource  use  subject  to  the  ari  .hmetic  average 
of  the  p  li  )  equaling  a  determined  value.  This  minimization  is  often  less 
complicated  t.nar.  minimization  subiect  to  the  product  oi  the  p.  ( s  )  having  the 
stated  value.  Also,  the  estimation  of  all  successes  is  simplified. 


